Evidence for a Vanishing Complexity of the Sherrington-Kirkpatrick model 
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Based on the modified Thouless- Anderson-Palmer equations a detailed numerical investigation for 
the complexity of the Sherrington-Kirkpatrick spin glass is worked out. The data suggest a scaling 
law which leads to a vanishing of the complexity in the thermodynamic limit as proposed recently. 
The results for the total number of stable states agree with existing approaches. 



An important and common feature of all glassy sys- 
tems with quenched disorder is the presence of a huge 
number N s of stable or metastable thermodynamic 
states. This number typically grows exponentially 



N s = exp(AT£* ot ) 



(1) 



with the size of the system N and determines the total 
complexity S tot . The number of states per free energy / 



N s (f) = N s g s (f) = exp[iVE(/)] = £ 5{f - f a ) (2) 



defines both the normalized density g s {f) and the com- 
plexity £(/) where the f a are the values of the free energy 
per particle of the states labelled by a = 1, . . . , N s . The 
complexity or the density g s (f) characterize the organi- 
zation of the thermodynamic states and is in addition 
expected to be of fundamental importance for an under- 
standing of the dynamics in glasses 

The Sherrington-Kirkpatrick (SK) spin glass Q is 
probably the simplest model to describe the physics of 
glasses. This model consists of N Ising spins connected 
to each other by the bonds Jij which are independent ran- 
dom variables of variance A^ 1 with zero means. Compu- 
tation of the complexity for the SK model were published 
more than two decades ago. The first was one presented 
by Bray and Moore (BM) [3j • Subsequent approaches ba- 
sically equivalent to BM are given in In these early 
approaches a modulus sign of a Hessian determinant was 
dropped without any serious justification. 

In a series of papers [HIS0 this procedure has recently 
been criticized claiming that inadequacies and even in- 
consistencies result. Moreover such difficulties are also 
found for an alternative, the so-called Becci-Rouet-Stora- 
Tyutin (BRST) symmetric solution. Thus Crisanti et al. 
(CLPR) proposed that no complexity occurs in the SK 
model. Contrary to the latter scenario Bray and Moore 
and Aspelmeier et al.[3] have very recently presented 
new arguments for the validity of the BM approach and 
concluded that this theory remains a viable candidate for 
the spin glass complexity. Thus the analytical investiga- 
tions of the complexity for the SK model are at present 
extremely controversial. 

In this letter a numerical investigation of these prob- 
lems is presented with the aim to clarify this contro- 
versy. Recalling that the thermodynamic states of the 



SK model are given by the solutions of the Thouless- 
Anderson-Palmer (TAP) equations [lfj, the method is 
obvious. Provided that the stable solution of these TAP 
equations and their associated free energies are known as 
function of the system size N it is just a simple count- 
ing and an extrapolation to the thermodynamic limit 
N — > oo which has to be performed to find the distri- 
bution Q s (f) and the total number of states N s . 

The main difficulty is the explicit determination of the 
TAP states. A solution of this problem has recently 
been proposed by the present author . This approach 
is based on a modification of the TAP equations which 
consistently describes both the stable solutions and the 
unstable solutions. Furthermore this approach employs a 
fictive dynamics to find the TAP solutions as fixed points 
of a set of equations of motion. These methods have been 
used to calculate successfully various physical quantities 
of the SK model 01 • Even some hints for behavior the 
complexity can be found in 0] . 

The latter methods are again used in the this work. 
Focusing exclusively on the complexity, the present in- 
vestigation on this subject is much more detailed than 
|l2| . As the main result of this letter, the numerical data 
demonstrate that the density Q s (f) tends to a 5-function 



Qs(f) — S(f-f eq ). 



(3) 



in the thermodynamic limit which in agreement with the 
CLPR proposal implies that there is no complexity £(/) 
in the SK model. As a further result the numerical data 
suggest that the total complexity S* ot exists and is given 
by the BM theory. Thus both controversial approaches, 
the BM theory and CLPR proposal agree in parts with 
the present work although these approaches seem to be 
disjunct in the present form. 

A vanishing complexity has interesting consequences. 
As all states have the same free energy value, none of 
them is thermodynamically preferred. Such a system 
is nothing else than a multi-phase system. The phase 
(or the mixture of phases) of any multi-phase system is 
generally selected by the (dynamic) history or by addi- 
tional secondary interactions (like conjugate or symme- 
try breaking fields in conventional multi-phase systems). 
Note that these mechanisms are characteristic for glasses. 
Thus it should be possible to transfer at least some of the 
well understood techniques for conventional multi-phase 
systems to the SK spin glass. 
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After the presentation and the brief discussion of the 
main results, some more details are given in the remain- 
ing part of this letter. With reference to [Til Il2^ the 
essence of the modified TAP approach and of the numer- 
ical procedure is reviewed followed by the analysis of the 
numerical data. 

In zero external field the modified TAP equations for 
the local magnetizations to; = (Sijp are given by the set 
of equations 



m i 



tanh/9{ ^ J, 



Xi} 



with the local susceptibility 



Xi = 



N 4^ 1 



0{1 - m 2 ) 



T 2 I3 2 {1- 



(4) 



(5) 



The quantity T is proportional to the density of zero 
eigenvalues of the inverse susceptibility matrix and is de- 
termined by 



r 

1 

where 



= 



/3 2 (l-mf) 2 



n ^ i + r 2 /? 2 (i 



-,2\2 



l-/3 2 (l-2q 2 + q 4 ) 



fora;>0 (6) 
for x < (7) 

(8) 



and where q u — A/' _1 ^ i m- / {y — 2,4) it introduced. 
These equations are exact in the thermodynamic limit 
but can approximatively be used for large finite N. 

The condition x = represents the central spin glass 
instability condition 0, Q, 0] . Above the instability 
(x > 0) the local susceptibility reduces to the isothermal 
value xi — 00- — 32) and the Eqs.QJ are in complete 
agreement with the orig inal TAP equations pU Es- 
sential differences result below the instability (x < 0) as 
r > and xi + 00 - 92) hold for the modified TAP 
equations. This implies negative eigenvalues of the sus- 
ceptibility matrix [llj. Thus all the states with x < 
are unstable and have therefore no relevance for thermo- 
dynamic quantities for N — > 00. 

For the stable states the free energy per spi n /({mi}) 
is given by the well known expressions |lCt Il5| 



/(M) = 



2N 



2 



(l-9 2 ) 2 (9) 



N 



1 + to,- 1 + nij 1 — m,i , 1 — to, 
— — - In H In - 



from which the free energy values f a — f({mf}) of the 
TAP solutions {mf } (a = 1, . . . , N s ) are obtained. 

The explicit calculation of these solutions {mf } em- 
ploys the relaxational Glauber dynamics 



TOt(i) 



tanh/3{ ^ J^rrij - miXi(t)}. (10) 



TABLE I: Specifications and results: N and N sya are the 
values of the sizes and the numbers of investigated systems 
respectively. The values for total complexity E tot and the 
fraction w + for solutions with x > represent averages over 

0.2. 



N 


Nsys 


number of runs " 




w+(%) 


81 


98 


200 [25000] 


0.0545 


7.5 


100 


57 


1000 [5000] 


0.0552 


7.5 


120 


27 


1000 


0.0512 


8.6 


150 


25 


150 [6000] 


0.0509 6 


11.0 


225 


10 


250 [29000] 


(0.0428) c 


10.8 


400 


6 


250 [1000] 


(0.0184) c 


9.0 


600 


4 


100 [400] 




6.7 


800 


2 


120 




7.7 



"The values in bracket apply only to one or two systems. 
'Average value calculated from 2 systems. 
c Lower bound for S*°* found in 1 system. 



where the local susceptibility xi (*) is related to the mj (i) 
via Eq.|0 and Eq.© or Eq.Q depending on the in- 
stantaneous value of x(t). The fixed points solutions of 
Ecis- HlOf) coincide with the TAP solutions and both so- 
lutions exhibit identical stability properties Note 
that the phenomenological Eas. Hll)|) do not correctly de- 
scribe dynamic effects (for microscopic equations of mo- 
tion compare pH Il7| ). They are, however, simple and 
are sufficient for the determination of the fixed point (or 
of the TAP) solutions. 

The numerical procedure is analogous to the former 
work 12] to which the reader is referred for details. 
Again the integration routine 'NDSolve' of Mathematica 
on workstations is used to determine the {mf } for a num- 
ber of systems with different sizes as listed in Tab[Q All 
runs start with random initial conditions for the magneti- 
zations {mf} and nearly exclusively binary distributions 
of the bonds Jy = ±Af -1 / 2 are used 0]- Although data 
for other temperatures are available the results presented 
are restricted to the temperature T = 0.2 following the 
previous work 0, S ■ 

First the results for the total complexity E'°* are given 
which are (annealed) averages over N sys systems. In 
Tab[I] the obtained values are listed for sizes N up to 
150 spins. The errors resulting from the system to sys- 
tem variations are found to be of the order of 10% . For 
N > 150 the numbers of runs are not sufficient to deter- 
mine E tot and at best some lower bounds can be given. 
From a strict point of view all values for E*°* are lower 
bounds as the applied procedure does not guarantee that 
all existing solutions are found. Based on investigations 
of some systems with a large number of runs, however, 
these errors can be estimated to be less than the un- 
certainty resulting from the system to system variations. 
For these estimates the decreases of the rate to find new 
solutions is analyzed when one increases the number of 



According to |(| , the BM value and the BRST value for 
the complexity at T = 0.2 is given by E^ f = .0522 and 
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FIG. 1: Histograms corresponding to the distribution P(N, v) 
as denned in Eg. 1111 versus v for various values of the sizes N 
at a temperature of T = 0.2. The contributions from solutions 
with x > 0, magnified by a factor of four, are indicated by 
the dark areas. The curves are fits resulting from the scaling 
law as described in the text. 
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FIG. 2: Widths Ai = - /™ in ) (upper data) and 

^2 = {fmin ~ fav) (lower data) plotted versus iV -1 / 3 at a 
temperature T = 0.2. The length of each error bar is two 
standard deviations. 



by ^brst — 0.0021, respectively. Thus the results for 
S tot presented in Tab[I] are in agreement with the BM 
value but in disagreement with the BRST value. The 
latter conclusion even applies to those cases where only 
lower bounds are given. 

Next the histograms corresponding to the densities 
Q s (f) are analyzed. It is noted that all the shapes of 
the histograms for the individual systems (labelled by 
the index n) look similar and are nearly Gaussian. Thus 



histograms of the centered distributions 
P(v, N) = + «)> with /« = £ f a (11) 



averaged over the N sys systems 



(12) 



are introduced an( i plotted in FigQ] Without any 
doubt the plots exhibit a narrowing of the P(v, N) with 
increasing values of N. Moreover this narrowing is com- 
patible with the scaling law 

N- s P(N, N- S v) = N~ s P(N, N- S v) = P(l, v) (13) 

for arbitrary values of N and N. With a deviation of 
less than one percent a standard numerical fitting leads 
to the value 



= 1/3. 



(14) 



Using for P(l,v) a normalized Gaussian function with a 
standard deviation of 0.09117 the resulting fits are pre- 
sented in Fig^ showing a good agreement with the his- 
tograms. Extrapolation of these results to N — > oo im- 
mediately leads to the main result of Eq. © . Indeed the 
scaling law implies P(N,v) = N s P(l,N s v) which 
is a standard representation of the 5-function. 

The scaling relation i|13|) implies consequences for fur- 
ther quantities. Denoting the extremal values of the free 
energy of a specific system by f% in and f^ ax the widths 
defined by Ai = (/™ a? - /™ m ) and by A 2 = (f™ m - f%) 
should vanish proportional to N s in the thermodynamic 
limit. Indeed this dependence is found according to Fig|2 
Note that in this analysis no assumptions on the shapes 
enter which further supports the scaling relation. 

FigEI shows the minimum value of free energy f m i„ = 
if mini averaged over the N sys systems as function of 
N^ 1 . In the thermodynamic limit the width A 2 vanishes. 
Thus the limiting value of f m in for N — > oo equals the 
value f eq which arises in Eq.Q. By linear extrapolation 
the numerical value f eq = —0.7619 is obtained which is 
in good agreement with the equilibrium value —0.7594 of 
the replica breaking approach at T = 0.2. 

Some points of the above analysis need additional com- 
ments. Analogous to the findings of 12] the x values of 
the majority of solutions are negative. Indeed according 
to Tab|U it is just a small fraction w + of the solutions 
which satisfy the condition x > 0. As discussed in ^3] 
the solutions with x < arise due to finite size effects and 
disappear with the power law \x\ ~ TV" 2 / 3 for N — * oo 
(compare Fig. 2 of This behavior which also applies 

to the states with x > and which is again found in 
the present approach is nothing else but the well known 
marginal stability of the TAP states in the thermody- 
namic limit. As shown in Fig^ both the states with 
x > and the states with x < are similar distributed. 
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FIG. 3: Minimum value of free energy f m m — ( /min) versus 
TV -1 at a temperature T = 0.2. The length of each error 
bar is two standard deviations. The equilibrium value of the 
replica breaking approach is represented by the circle. 

Thus a separate analysis of the complexity is not needed 
for these two types of states. 

Recall that for systems with large N only a part of the 
TAP states can be determined and that only this part en- 
ters in the histograms of Fig^ Therefore the interpreta- 
tion of these histograms as Q s (f) requires the assumption 
that this part of the states are representative for the set 
of all states. This assumption is checked for the systems 
where nearly all solutions are found. It is found that 
the first hundred runs give already reasonable approxi- 
mations of the final results using several thousands runs. 
No significant changes result for the histograms, for the 



values f£ v and for fmin- Some deviations are found at 
the upper tail of the distribution where a few new solu- 
tions are obtained when increasing the number of runs 
leading to maximal changes of 20% for f^ ax — f^ in and 
thus do not affect the basic results of this work. 

In particular there is no hint that the range of the free 
energies Ai increases to the BM value which is several 
times larger than the typical numerical values. Moreover 
according to BM results the number of these additional 
states should be large (a finite fraction of the total num- 
ber of N s ). Thus a finite probability is expected to find at 
least some of these states which however is not the case. 
These arguments also apply if one takes in account that 
dynamical algorithms usually tend to prefer the states 
with lower free energy [2(J. This effect is clearly ob- 
served in the present investigation. In disagreement to 
0, however, it is concluded that this effect is not suffi- 
ciently distinctive to explain the huge differences to the 
BM approach. 

Summing up, the numerical investigations demon- 
strate that the existing analytical approaches for the 
complexity of the SK model are at best partially valid. 
The present work strongly supports the CLPR proposal 
that there is no complexity for this model. Finally the 
scaling relation suggested by the numerical results may 
potentially be a guide for working out a consistent ana- 
lytic theory. 

Interesting discussions with A. Crisanti, B. Drossel, S. 
Kobe, L. Leuzzi, M. Moore and T. Rizzo are acknowl- 
edged. 
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